#mainTextBox Now we have added a scheduling icon to the "step gradient" component. We have set it to gradually decrease the learning rate from 0.02 to .0001 by subtracting .005 (beta) each epoch. We have also added a matrix viewer to show how the learning rate changes over time. Run the network and see how the network quickly adapts to the right region of weight space and then the rattling is reduced as the learning rate decreases.
#titleTextBox Scheduling the Learning Rate
#subtitleTextBox Summary
#mainTextBox In this demonstration we have showed the ability to control learning time AND rattle by scheduling the learning rate. You should explore this breadboard by changing the scheduler parameters and observe the effects. One gets more flexibility but also an extra parameter that needs to be appropriately set for good performance. You can substitute the linear scheduler by others (exponential or logaritmic). Just open the "schedule" palette and replace the linear scheduler.
